Electronic device and method for using captured image in electronic device

ABSTRACT

An electronic device is provided. The electronic device includes a display configured to display an application execution screen and a controller configured to, when a screen image of the application execution screen is captured, obtain execution path information for executing a state of the captured screen image, and to store the captured screen image and the execution path information.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. §119(a) of a Koreanpatent application filed on Aug. 23, 2013 in the Korean IntellectualProperty Office and assigned Serial number 10-2013-0100713, and of aKorean patent application filed on Apr. 24, 2014 in the KoreanIntellectual Property Office and assigned Serial number 10-2014-0049459,the entire disclosure of each of which is hereby incorporated byreference.

TECHNICAL FIELD

The present disclosure relates to an electronic device and technologyfor using captured images in an electronic device.

BACKGROUND

Currently, electronic devices have been developed as portable terminalsthat users may carry with them, and functions of the electronic deviceshave been diversified.

Accordingly, various functions for user's convenience are built in anelectronic device, and the electronic device may activate each of thefunctions depending on the user's manipulation for each of thefunctions, so the function may be executed.

For example, if an electronic device has a built-in capture function,the electronic device may capture various screens displayed on theelectronic device using the capture function, and store the capturedimages.

However, the conventional screen capture function may simply storecaptured images as images, and there are not many ways to use thecaptured images. For example, the captured images may be simply used forimage processing, such as used for copying and pasting, or for usingobjects in the captured images.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an electronic device capable of using acaptured image in a variety of ways, and a method for using a capturedimage in the electronic device.

Another aspect of the present disclosure is to provide an electronicdevice for storing a captured screen image together with execution pathinformation for executing the screen that was displayed during thescreen capture, to make it possible to execute later on the screen thatwas displayed during the screen capture using the captured screen image,and a method for using a captured image in the electronic device.

Another aspect of the present disclosure is to provide an electronicdevice for sharing a captured screen image and execution pathinformation for executing the screen that was displayed during thescreen capture in an electronic device of a user, with anotherelectronic device of the same user or an electronic device of anotheruser, thereby making it possible to execute the screen that wasdisplayed during the screen capture using the captured screen image evenin another electronic device of the same user or an electronic device ofanother user, and a method for using a captured image in the electronicdevice.

In accordance with an aspect of the present disclosure, an electronicdevice is provided. The electronic device includes a display configuredto display an application execution screen and a controller configuredto, when a screen image of the application execution screen is captured,obtain execution path information for executing a state of the capturedscreen image, and to store the captured screen image and the executionpath information.

In accordance with another aspect of the present disclosure, a methodfor using a captured screen in an electronic device is provided. Themethod includes capturing a screen image of an application executionscreen, obtaining execution path information for executing a state ofthe captured screen image, and storing the captured screen image and theexecution path information.

In accordance with further another aspect of the present disclosure, anon-transitory storage medium storing a program for using a capturedscreen is provided. The program executed in a controller of anelectronic device includes a command to perform a method. The methodincludes capturing a screen image of an application execution screen,obtaining execution path information for executing a state of thecaptured screen image, storing the captured screen image and theexecution path information, and transmitting the captured screen imageand the execution path information to share the captured screen imageand the execution path information.

In accordance with another aspect of the present disclosure, a datasharing server is provided. The data sharing server includes a storageunit configured to store data including a captured screen image andexecution path information corresponding to the captured screen image,the data being uploaded from a first electronic device and a controllerconfigured to, when the data is uploaded, transmit the stored data to asecond electronic device that accesses the data sharing server with thesame account as that of the first electronic device.

In accordance with still another aspect of the present disclosure, adata sharing server is provided. The data sharing server includes astorage unit configured to store data including a captured screen imageand execution path information corresponding to the captured screenimage, the data being uploaded from a first electronic device and acontroller configured to transmit a Uniform Resource Locator (URL) ofuploaded data to the first electronic device when the data is uploaded,and to transmit the uploaded data to a second electronic device uponreceiving a data request made based on the URL of the uploaded data fromthe second electronic device that has received the URL of the uploadeddata from the first electronic device.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a block diagram of an electronic device according to anembodiment of the present disclosure;

FIG. 2 is a flowchart illustrating an operation of using a capturedimage in an electronic device according to an embodiment of the presentdisclosure;

FIG. 3 illustrates an application framework and an application accordingto an embodiment of the present disclosure;

FIG. 4 is a flowchart illustrating an operation of obtaining executionpath information through an application framework according to anembodiment of the present disclosure;

FIG. 5 illustrates an example of information needed to execute a stateof a captured screen, in the information that may be included in a classobject according to an embodiment of the present disclosure;

FIG. 6 is a flowchart illustrating an operation of obtaining executionpath information through an application according to an embodiment ofthe present disclosure;

FIGS. 7A, 7B, and 7C illustrate an example of an operation of selectingat least a part of a captured screen according to an embodiment of thepresent disclosure;

FIG. 8A illustrates the concept of capturing an application screen andobtaining execution path information corresponding to a captured imagein an electronic device according to an embodiment of the presentdisclosure;

FIG. 8B illustrates the concept of operating using execution pathinformation corresponding to a captured screen in an electronic deviceaccording to an embodiment of the present disclosure;

FIGS. 9A, 9B, 9C, and 9D illustrate an example of using a captured imageduring execution of a web browser application in an electronic deviceaccording to an embodiment of the present disclosure;

FIGS. 10A, 10B, 10C, and 10D illustrate an example of using a capturedimage during execution of a music playback application in an electronicdevice according to an embodiment of the present disclosure;

FIGS. 11A, 11B, 11C, 11D, and 11E illustrate an example of using acaptured image during execution of a clip application in an electronicdevice according to an embodiment of the present disclosure;

FIG. 12 is a flowchart illustrating an operation of sharing a capturedimage in an electronic device according to an embodiment of the presentdisclosure;

FIG. 13 illustrates a system for sharing a captured image and executionpath information corresponding to the captured image according to afirst embodiment of the present disclosure;

FIG. 14 illustrates an operation of a system for sharing a capturedimage and execution path information corresponding to the captured imageaccording to the first embodiment of the present disclosure;

FIG. 15 illustrates a system for sharing a captured image and executionpath information corresponding to the captured image according to asecond embodiment of the present disclosure;

FIG. 16 illustrates an operation of a system for sharing a capturedimage and execution path information corresponding to the captured imageaccording to the second embodiment of the present disclosure;

FIG. 17 illustrates the concept of sharing a captured image andexecution path information corresponding to the captured image accordingto a third embodiment of the present disclosure;

FIG. 18 illustrates an operation of sharing a captured image andexecution path information corresponding to the captured image betweenelectronic devices according to the third embodiment of the presentdisclosure;

FIGS. 19A, 19B, 19C, 20A, 20B, 20C, 21A, 21B, 21C, 22A, 22B, 22C, and22D illustrate user interface screens for sharing a captured image andexecution path information corresponding to the captured image in anelectronic device according to an embodiment of the present disclosure;

FIG. 23 illustrates an SCC file structure according to an embodiment ofthe present disclosure;

FIG. 24 illustrates META-INF included in an SCC file according to anembodiment of the present disclosure; and

FIG. 25 illustrates metadata according to an embodiment of the presentdisclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skilled in the art will recognize thatvarious changes and modifications of the various embodiments describedherein may be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

By the term “substantially” it is meant that the recited characteristic,parameter, or value need not be achieved exactly, but that deviations orvariations, including for example, tolerances, measurement error,measurement accuracy limitations and other factors known to those ofskill in the art, may occur in amounts that do not preclude the effectthe characteristic was intended to provide.

An electronic device according to various embodiments of the presentdisclosure may include any device having a communication function. Forexample, the electronic device may include at least one of a smartphone, a tablet Personal Computer (PC), a mobile phone, a video phone,an e-book reader, a desktop PC, a laptop PC, a netbook computer, aPersonal Digital Assistant (PDA), a Portable Multimedia Player (PMP), anMP3 player, a mobile medical device, a camera, and a wearable device(e.g., a Head Mounted Device (HMD) (such as electronic eyeglasses),electronic apparel, an electronic bracelet, an electronic necklace, anelectronic appcessory, an electronic tattoo, a smartwatch and the like).

In accordance with certain embodiments of the present disclosure, anelectronic device may be a smart home appliance having a broadcastchannel reception function. The smart home appliance may include, forexample, at least one of a TeleVision (TV), a Digital Versatile Disk(DVD) player, an audio set, a refrigerator, an air conditioner, acleaner, an oven, a microwave oven, a washer, an air cleaner, a set topbox, a TV box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), agame console, an electronic dictionary, an electronic key, a camcorder,an electronic photo frame, or the like.

In accordance with certain embodiments of the present disclosure, anelectronic device may include at least one of various medical devices(e.g., Magnetic Resonance Angiography (MRA), Magnetic Resonance Imaging(MRI), Computed Tomography (CT), medical camcorder, ultrasonic equipmentand the like) having a broadcast channel reception function, anavigation device, a Global Positioning System (GPS) receiver, an EventData Recorder (EDR), a Flight Data Recorder (FDR), an automotiveinfotainment device, marine electronic equipment (e.g., marinenavigation system, gyro compass and the like), avionics, securityequipment, an industrial or household robot, and the like.

In accordance with certain embodiments of the present disclosure, anelectronic device may include at least one of a part of the furniture orbuilding/structure having a broadcast channel reception function, anelectronic board, an electronic signature receiving device, a projector,or various measurement devices (e.g., tap water measurement device,electricity measurement device, gas measurement device, radio wavemeasurement device, and the like). An electronic device according tovarious embodiments of the present disclosure may be one of the abovevarious devices, or a combination thereof. It will be apparent to thoseof ordinary skill in the art that an electronic device according tovarious embodiments of the present disclosure is not limited to theabove-described devices.

An electronic device according to various embodiments of the presentdisclosure will now be described with reference to the accompanyingdrawings. The term ‘user’ as used in various embodiments of the presentdisclosure may refer to a person who uses an electronic device, or adevice (e.g., an artificial electronic device) that uses the electronicdevice.

FIG. 1 is a block diagram of an electronic device according to anembodiment of the present disclosure.

Referring to FIG. 1, an electronic device 100 may include a controller110, a communication unit 120, a storage unit 130, a touch screen 140,and an Input/Output (I/O) unit 150, but is not limited thereto.

The controller 110 may include a Central Processor Unit (CPU) 111. Inaddition, the controller 110 may include a Digital Signal Processor(DSP) (not shown), and may also include a Read Only Memory (ROM) 112storing a control program for control of the electronic device 100, anda Random Access Memory (RAM) 113 that temporarily stores the signals ordata received from the outside of the electronic device 100, or is usedas a workspace for operations executed in the electronic device 100. TheCPU 111 may include a single-core processor, a dual-core processor, atriple-core processor, a quad-core processor, or the like. The CPU 111,the ROM 112 and the RAM 113 may be interconnected through an internalbus.

The controller 110 may control the communication unit 120, the storageunit 130, the touch screen 140 and the I/O unit 150. In other words, thecontroller 110 may perform the overall control function for theelectronic device 100, and may control a signal flow between thecomponents of the electronic device 100.

For example, the controller 110 may display an application screen on thetouch screen 140 in response to execution of an application according toan embodiment of the present disclosure. The controller 110 may performscreen capture on the application screen displayed on the touch screen140. For example, the controller 110 may continuously displayapplication screens on the touch screen 140 in response to execution ofan application during the execution of the application, and capture arequested application screen among the application screens. In addition,the controller 110 may obtain execution path information correspondingto the captured screen, and the execution path information correspondingto the captured screen may include information for executing a state ofthe captured screen.

For example, the controller 110, which includes an application frameworkand an application, may execute the application using execution pathinformation obtained through the application framework or theapplication, display screens associated with execution of theapplication, and obtain execution path information corresponding to thecaptured application screen. The controller 110 may store execution pathinformation corresponding to the captured screen together with an imageof the whole or a selected part of the captured screen. If the storedimage is selected, the controller 110 may detect execution pathinformation corresponding to the selected image, and perform a processcorresponding to the selected image using the execution pathinformation.

The communication unit 120 may connect the electronic device 100 toexternal devices (not shown). The external devices may include anotherdevice (not shown), a cellular phone (not shown), a smart phone (notshown), a tablet PC (not shown), and a server (not shown). Thecommunication unit 120, under control of the controller 110, may connectthe electronic device 100 to external devices through mobilecommunication, using one or multiple antennas (not shown). Thecommunication unit 120 may transmit and receive wireless signals forvoice calls, video calls, Short Message Service (SMS) messages orMultimedia Messaging Service (MMS) messages, to/from a cellular phone(not shown), a smart phone (not shown), a tablet PC (not shown) oranother device (not shown), a phone number of each of which is enteredor registered in the electronic device 100. The communication unit 120may further include at least one of a Wireless Local Area Network (WLAN)module (not shown) and a short-range communication module (not shown).The WLAN module, under control of the controller 110, may access theInternet in the place where a wireless Access Point (AP) (not shown) isinstalled. The WLAN module may support the WLAN standard IEEE802.11xproposed by Institute of Electrical and Electronics Engineers (IEEE).The WLAN module, under control of the controller 110, may enablewireless short-range communication between the electronic device 100 andan image forming apparatus (not shown). The short-range communicationscheme may include Bluetooth, Infrared Data Association (IrDA) and thelike.

The storage unit 130, under control of the controller 110, may store thesignals or data which are input/output in response to operations of thecommunication unit 120, the touch screen 140 and the I/O unit 150. Thestorage unit 130 may store a plurality of programs and applications forcontrol of the electronic device 100 or the controller 110, and theprogram and data for executing various functions. The storage unit 130may store an image of the whole or at least a part of a captured screenaccording to an embodiment of the present disclosure, and may store aprogram for using a captured image mentioned in the present disclosure.

The term ‘storage unit’ as used herein may be construed to include theROM 112 and RAM 113 in the controller 110, or a memory card (not shown)(e.g., Secure Digital (SD) card, a memory stick and the like) mounted inthe electronic device 100. The storage unit 130 may include anonvolatile memory, a volatile memory, a Hard Disk Drive (HDD), a SolidState Drive (SSD) or the like.

The storage unit 130 may be a machine (e.g., computer)-readable medium,and the term ‘machine-readable medium’ may refer to a medium thatprovides data to machine so that the machine may perform a specificfunction. The machine-readable medium may be storage medium. The storageunit 130 may include nonvolatile media and volatile media. All of thesemedia should be configured such that commands carried by the media maybe detected by the physical mechanism that reads the commands by themachine. The machine-readable medium may include, though not limitedthereto, at least one of floppy disk, flexible disk, hard disk, magnetictape, Compact Disc Read Only Memory (CD ROM), optical disk, punch card,paper tape, RAM, Programmable Read Only Memory (PROM), Erasable PROM(EPROM), and flash EPROM.

The I/O unit 150 may include a button(s) 152, a MICrophone (MIC) 154, aSPeaKer (SPK) 156, and an input unit 158. In addition, to the I/O unit150 may be provided a cursor controller such as a mouse, a trackball, ajoystick, cursor direction keys or the like, for communication with thecontroller 110 and for control of the movement of a cursor on the touchscreen 140.

The microphone 154, under control of the controller 110, may generate anelectrical signal by receiving voices or sounds from various soundsources.

The speaker 156, under control of the controller 110, may output soundscorresponding to various signals (e.g., wireless signal, broadcastsignal, digital audio file, digital video file and the like) generatedby the communication unit 120 or the execution of an application, to theoutside of the electronic device 100.

The input unit 158 may be a device or object that is kept inside theelectronic device 100, or separately configured. When kept inside theelectronic device 100, the input unit 158 may be drawn out or detachedfrom the electronic device 100. The input unit 158 may be an input meansfor making a proximity or touch input onto the touch screen 140, such asa stylus pen (hereinafter referred to as a ‘pen’), or may be a user'sfinger(s).

The touch screen 140 may be a display, and may provide Graphic UserInterfaces (GUIs) to the user during execution of various applications.For example, the touch screen 140 may receive various gesture inputssuch as proximity or touch input through, for example, the user's body(e.g., fingers including the thumb) or the pen (e.g., the input unit158). The touch screen 140 may be implemented in, for example, aresistive type, a capacitive type, an infrared type, or an acoustic wavetype. In accordance with an embodiment of the present disclosure, thetouch screen 140, under control of the controller 110, may displayscreens associated with execution of an application and their capturedscreens, and may display at least a part of the captured screen.

FIG. 2 is a flowchart illustrating an operation of using a capturedimage in an electronic device 100 according to an embodiment of thepresent disclosure.

Referring to FIG. 2, the electronic device 100 may capture anapplication screen in operation 210.

For example, the electronic device 100 may capture the currentlydisplayed application screen in response to a screen capture requestfrom the user during the execution of an application.

Specifically, the electronic device 100 may capture the currentlydisplayed web page screen in response to a screen capture request fromthe user during the execution of a web browsing application, or maycapture the currently displayed music playback screen in response to ascreen capture request from the user during the execution of a musicplayback application. In addition, the electronic device 100 may capturethe currently displayed clip screen in response to a screen capturerequest from the user during the execution of a clip application.

In operation 220, the electronic device 100 may obtain execution pathinformation corresponding to the captured screen. The execution pathinformation may include information for executing a state of thecaptured screen.

For example, the electronic device 100 may obtain execution pathinformation corresponding to the captured application screen, using anapplication framework and an application.

FIG. 3 illustrates an application framework and an application accordingto an embodiment of the present disclosure.

Referring to FIG. 3, an application framework 310 may be a collection ofa class and a library for implementing the standard structure of anapplication program. The application framework 310 may include numerouscommon class objects that may be used in common in various applications,and internal class objects that may be used in a specific application.The application framework 310 may execute an application 320 so thatscreens associated with the execution of an application may be displayedon the touch screen 140. The application framework 310 may be aframework based on the Android™ Operating System (OS), or a frameworkbased on iOS™. The application framework 310 may be a framework based onany other OSs for electronic devices.

In accordance with an embodiment of the present disclosure, theelectronic device 100 may obtain execution path informationcorresponding to a captured application screen through the applicationframework 310, or may obtain execution path information corresponding toa captured application screen through the application 320.

FIG. 4 is a flowchart illustrating an operation of obtaining executionpath information through an application framework 310 according to anembodiment of the present disclosure.

Referring to FIG. 4, the application framework 310 may determine inoperation 410 whether an application screen is captured.

If an application screen is captured during the execution of anapplication, the application framework 310 may determine a class objectcorresponding to the captured screen among the numerous class objects inoperation 420.

In operation 430, the application framework 310 may obtain executionpath information using the information included in the class objectcorresponding to the captured screen.

For example, the application framework 310 may obtain execution pathinformation by extracting the information needed to execute a state ofthe captured screen, from the information included in the class object.

FIG. 5 illustrates an example of information needed to execute a stateof a captured screen, in the information that may be included in a classobject according to an embodiment of the present disclosure.

Referring to FIG. 5, information needed to execute a state of a capturedscreen, in the information that may be included in a class object, mayinclude information such as Uniform Resource Identifier (URI), String,Boolean, byte (binary), Short, Integer, Float, Double, Date, Time, ClassObject and the like. In addition, any information is possible as long asthe information is the related information for executing a capturedscreen.

URI may be URI information corresponding to the screen that wasdisplayed during the execution of the captured screen. String may bestring information that was displayed during the execution of thecaptured screen. For example, String may include text informationincluding a phone number-related name, a phone number-relatedapplication name and the like, which were displayed during the executionof display of a phone number. Boolean may include decision parametervalue information (true, false) of an application. Byte (binary) may bebinary data information. The binary data information may be informationobtained by binarizing the information that was displayed (or used)during the execution of the captured screen, such as an image file,texts and the like. Short, which is short-length byte variableinformation, may include information about an integer within a smallrange, which was displayed (or used) during the execution of thecaptured screen. Integer, which is information about a number of 0 to255, may include information about a number, which was displayed (orused) during the execution of the captured screen. Float, which isinformation about a decimal point number, may include information abouta decimal point number, which was displayed (or used) during theexecution of the captured screen. Double, which is information about adecimal point number, the number of digits of which is large, mayinclude information about a decimal point number, which was used duringthe execution of the captured screen. Date, which is date information,may include date information indicating the date during the execution ofthe captured screen. Time, which is time information, may include thetime information indicating the time during the execution of thecaptured screen. Class Object, which is information about an internalclass object, may include internal class object information that wasused during the execution of the captured screen. It will be apparent tothose of ordinary skill in the art that the class object may include anyother information for executing the captured screen.

The application framework 310 may obtain execution path information forexecuting a state of a captured screen using the above informationincluded in the class object.

In accordance with an embodiment of the present disclosure, theelectronic device 100 may also obtain execution path informationcorresponding to a captured application screen through the application320.

FIG. 6 is a flowchart illustrating an operation of obtaining executionpath information through an application 320 according to an embodimentof the present disclosure.

Referring to FIG. 6, the application 320 may determine in operation 610whether an application screen is captured.

If an application screen is captured during the execution of anapplication, the application 320 may obtain URI informationcorresponding to the captured screen in operation 620. The URIinformation may have a format of <ApplicationName>://<details> (ex.smartclip://1.png), and the like.

In operation 630, the application 320 may deliver the obtained URIinformation corresponding to the captured application screen to theapplication framework 310 in charge of the capture function.

Referring back to FIG. 2, the electronic device 100 may select an imageof at least a part of the captured screen in operation 230.

FIGS. 7A to 7C illustrate an example of an operation of selecting atleast a part of a captured screen according to an embodiment of thepresent disclosure.

Referring to FIGS. 7A to 7C, the electronic device 100 may select anentire image 710 of the captured application screen as in FIG. 7A. Theelectronic device 100 may select an image 720 corresponding to aspecific object in the captured application screen as in FIG. 7B. Theelectronic device 100 may select an image 730 in a closed circle that isdrawn on the captured application screen by the input unit 158 such asthe electronic pen or the user's finger, as in FIG. 7C. In addition,ways to select at least a part of the captured screen may include manydifferent ways such as a way to select an object depending on a drawinginput (straight line, curved line and the like) for connecting objectsexisting on the screen, and a way to directly select a specific objectexisting on the screen.

In operation 240, the electronic device 100 may store the execution pathinformation together with the image of at least a part of the capturedscreen.

For example, the electronic device 100 may store execution pathinformation together with the entire image of the captured screen, orstore execution path information together with an object in the capturedscreen, or store execution path information together with an image ofthe part that is selected by the user with a drawing input on thecaptured screen using the electronic pen, finger and the like.

The electronic device 100 may store the execution path information as aDataBase (DB) or a file, or may store the execution path information byincluding or inserting the execution path information in a metadata areain an image of at least a part of the captured screen.

The stored image (e.g., the entire image of the captured screen or theimage of at least a part of the captured screen) may be displayed lateron a captured image display screen at the user's request. The user mayselect the stored image from the captured image display screen.

If the stored image is selected in operation 250, the electronic device100 may read the execution path information that is stored together withthe selected image in operation 260.

For example, if the execution path information is stored as a DB or afile, the electronic device 100 may read the DB or the file. If theexecution path information is stored in a metadata area in an image ofat least a part of the captured screen, the electronic device 100 mayread the execution path information from the metadata area.

In operation 270, the electronic device 100 may execute a state of thecaptured screen using the read execution path information.

For example, if the state of the captured screen was a state ofdisplaying a contact detail view screen during the execution of aphonebook application, the electronic device 100 may display the contactdetail view screen using the execution path information without arequest for execution of the phonebook application for viewing thecontact details.

If the state of the captured screen was a state of displaying a specificweb page screen during the execution of a web browser application, theelectronic device 100 may display the specific web page screen using theexecution path information without an input of a request for executing aweb browser and an input of an address for viewing the specific web pagescreen.

If the state of the captured screen was a state of displaying a specificmusic playback screen during the execution of a music playbackapplication, the electronic device 100 may display a music playbackscreen at the time of the screen capture using the execution pathinformation and play the music at the time of the screen capture,without a request for executing a music playback application and aninput for requesting playback of specific music. In addition, inaccordance with various embodiments of the present disclosure, the stateof the captured screen may be a state during the execution of variousapplications, and the electronic device 100 may immediately execute thestate of the captured screen using the execution path information,without an input for going to the state of the captured screen byexecuting the various applications.

In accordance with an embodiment of the present disclosure, theapplication 320 may be an application program that may be executed inthe electronic device 100. The application 320 may be applications forperforming various functions, such as, for example, a phonebookapplication, a web browser application, a music playback application, aclip application, a scrapbook application and the like.

In accordance with an embodiment of the present disclosure, theapplication framework 310 may execute at least one of the variousapplications, and display screens corresponding to the execution of theapplication on the touch screen 140. If an application execution screenis captured in response to a user input during the execution of anapplication, the application framework 310 may obtain execution pathinformation corresponding to an image (hereinafter referred to as a‘captured image’) of at least a part of the captured applicationexecution screen, and store the captured image and the execution pathinformation corresponding to the captured image. The captured image maybe the entire image of the captured application screen, or a partialimage that is cropped by the user's drawing input on the capturedapplication screen.

FIG. 8A illustrates the concept of capturing an application screen andobtaining execution path information corresponding to a captured imagein an electronic device according to an embodiment of the presentdisclosure.

Referring to FIG. 8A, an application framework 810 may correspond to aframework layer 801, and various applications 821 to 824 may correspondto an application layer 802. In accordance with an embodiment of thepresent disclosure, the various applications 821 to 824 may include ascrapbook application 821, a web browser application 822, a videoplayback application 823, and a music playback application 824. Thevarious applications 821 to 824 may further include other applications.

In accordance with an embodiment of the present disclosure, while anapplication execution screen is displayed, the application framework 810may capture the application execution screen in response to a user input842 (e.g., a screen capture request input from the user), and obtain acaptured image and execution path information corresponding to thecaptured image, in operation 844.

In accordance with an embodiment of the present disclosure, theexecution path information corresponding to the captured image mayinclude metadata. The metadata may include a title corresponding to theapplication execution screen, a Uniform Resource Locator (URL) forrestoring the application execution screen, a text corresponding to theapplication execution screen, a data file (e.g., a music file, a videofile or an image file) corresponding to the application executionscreen, drawing memo information corresponding to the applicationexecution screen, handwriting recognition result informationcorresponding to the application execution screen, clip locationinformation corresponding to the application execution screen, and thelike.

In accordance with an embodiment of the present disclosure, the metadatamay further include deep link information. The deep link information maybe information for directly accessing resources used on the applicationexecution screen. For example, the deep link information may be a directlink to the resources such as video, sound and image files related tothe application execution screen. In addition, the deep link informationmay be information for accessing a sub page in a main page on theapplication execution screen.

In accordance with an embodiment of the present disclosure, theapplication framework 810 may store the captured image and the executionpath information (e.g., metadata) corresponding to the captured image ina DB 830 (or a file system) in operation 846.

In accordance with an embodiment of the present disclosure, the DB 830may be accessed by the scrapbook application 821. The scrapbookapplication 821 may access the DB 830 and load the captured image andthe execution path information (e.g., metadata) corresponding to thecaptured image, which are stored in the DB 830, in operation 840, andmay restore and execute the captured application execution screendepending on the loaded information.

FIG. 8B illustrates the concept of restoring and executing a capturedapplication execution screen in an electronic device according to anembodiment of the present disclosure.

Referring to FIG. 8B, the scrapbook application 821 may access the DB830 and load the captured image and the execution path information(e.g., metadata) corresponding to the captured image, which are storedin the DB 830, in operation 850. The scrapbook application 821 mayrequest execution depending on the execution path information inoperation 852. In accordance with an embodiment of the presentdisclosure, the scrapbook application 821 may request executiondepending on the execution path information (e.g., metadata).

The application framework 810 may restore and execute the applicationexecution screen depending on the execution path information inoperation 854. In accordance with an embodiment of the presentdisclosure, the application framework 810 may restore and execute theapplication execution screen depending on the metadata, for at least oneor more applications.

FIGS. 9A to 9D illustrate an example of using a captured image duringexecution of a web browser application in an electronic device accordingto an embodiment of the present disclosure.

Referring to FIG. 9A, the electronic device 100 may capture a web pagescreen while displaying a web page screen 910 during the execution of aweb browser application as in FIG. 9A.

Referring to FIG. 9B, the electronic device 100 may select an image ofthe entire or at least a part in a captured web page screen 920. In theexample of FIG. 9B, the electronic device 100 may select an image 930 ina closed circle that is drawn by the user. An image in the desired formof a rectangle, a circle, a polygon and the like may be selected by theuser on the web page screen. The electronic device 100 may store theselected image 930 and execution path information corresponding to thecaptured screen together.

Referring to FIG. 9C, the electronic device 100 may display a storedimage 950 on a captured image display screen 940, allowing the user toselect the stored image 950. The user may directly select the storedimage 950, or may select a button 960 for requesting to execute a stateof the stored image 950.

Referring to FIG. 9D, if the user selects the stored image 950 or thebutton 960 for requesting to execute a state of the stored image 950,the electronic device 100 may execute a state 970 of the captured screencorresponding to the stored image 950 as in FIG. 9D.

FIGS. 10A to 10D illustrate an example of using a captured image duringexecution of a music playback application in an electronic deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 10A, the electronic device 100 may capture a musicplayback screen while displaying a music playback screen 1010 during theexecution of a music playback application as in FIG. 10A.

Referring to FIG. 10B, the electronic device 100 may select an image ofthe entire or at least a part in a captured music playback screen 1020.In the example of FIG. 10B, the electronic device 100 may select animage 1030 in a closed circle that is drawn by the user. An image in thedesired form of a rectangle, a circle, a polygon and the like may beselected by the user in a desired position on the web page screen. Theelectronic device 100 may store the selected image 1030 and executionpath information corresponding to the captured music playback screentogether. For example, the selected image 1030 and the execution pathinformation corresponding to the captured music playback screen mayinclude URI information and music playback period information (or playtime) at the time of the screen capture.

Referring to FIG. 10C, the electronic device 100 may display a storedimage 1050 on a captured image display screen 1040, allowing the user toselect the stored image 1050. The user may directly select the storedimage 1050, or may select a button 1060 for requesting to execute astate of the stored image 1050.

Referring to FIG. 10D, if the user selects the stored image 1050 or thebutton 1060 for requesting to execute a state of the stored image 1050,the electronic device 100 may execute a state of the captured screencorresponding to the stored image 1050 as in FIG. 10D. For example, theelectronic device 100 may play the music at a music playback pointcorresponding to the captured screen.

FIGS. 11A to 11E illustrate an example of using a captured image duringexecution of a clip application in an electronic device according to anembodiment of the present disclosure.

Referring to FIG. 11A, the electronic device 100 may capture a clipscreen while displaying a clip screen 1110, on which clipped texts aredisplayed, during the execution of a clip application as in FIG. 11A.

Referring to FIG. 11B, the electronic device 100 may select an image ofthe entire or at least a part in a captured clip screen 1120. Inaccordance with an embodiment of the present disclosure, the electronicdevice 100 may crop an image of the entire or at least a part by theuser's drawing input on the captured clip screen 1120, and select thecropped image. In the example of FIG. 11B, the electronic device 100 mayselect an image 1130 in a closed circle that is drawn by the user. Animage in the desired form of a rectangle, a circle, a polygon and thelike may be selected by the user in a desired position on the capturedclip screen.

Referring to FIG. 11C, the electronic device 100 may store the selectedimage 1130 and execution path information corresponding to the capturedclip screen together. The execution path information corresponding tothe captured clip screen may include URI information such as‘slookdemos://SmartClip’.

Referring to FIG. 11D, the electronic device 100 may display a storedimage 1150 on a captured image display screen 1140, allowing the user toselect the stored image 1150. The user may directly select the storedimage 1150, or may select an icon 1160 for requesting to execute a stateof the stored image 1150.

Referring to FIG. 11E, if the user selects the stored image 1150 or theicon 1160 for requesting to execute a state of the stored image 1150,the electronic device 100 may execute a state of the captured originalscreen corresponding to the stored image 1150 as in FIG. 10E. Forexample, the electronic device 100 may display a clip screencorresponding to the captured screen.

In accordance with the above-described various embodiments of thepresent disclosure, if the user captures a screen while viewing thescreen associated with the execution of an application, the electronicdevice may store an image of at least a part of the captured screen andexecution path information for executing a state of the captured screen,allowing the user to execute a state of the captured screen using thecaptured screen.

For example, if the user selects an image of at least a part of thestored web page screen, a state of the web page screen may be executed.Therefore, the user may omit the user input operation of executing a webbrowser to execute a state of the web page screen and entering a webpage address on the web browser.

If the user selects an image of at least a part of the stored multimediacontent playback screen, a state of the multimedia content playbackscreen may be executed. Therefore, the user may omit the user inputoperation of executing a multimedia content playback application toexecute a state of the multimedia content playback screen and selectingmultimedia content to be executed by the multimedia content playbackapplication. Specifically, the multimedia content may include not onlythe music and video, but also a variety of content that may be played inthe electronic device. In the case where the multimedia content ismusic, if the user selects an image of at least a part of a multimediaplayback screen, such as the stored music and video, a state of themusic playback screen may be executed. Therefore, the user may omit theuser input operation of executing a music playback application toexecute a state of the music playback screen and selecting music to beplayed in the music playback application.

In addition, if the user selects an image of at least a part of thestored clip screen, a state of the clip screen may be executed.Therefore, the user may omit the user input operation of executing aclip application to display a clip screen and selecting a clip screen tobe displayed in the clip application.

It will be apparent to those of ordinary skill in the art that theexecution based on the captured screen may be applied to variousapplications even in other embodiments of the present disclosure.

In accordance with various embodiments of the present disclosure, theelectronic device 100 may share an image captured from an applicationexecution screen, and execution path information corresponding to thecaptured image.

FIG. 12 is a flowchart illustrating an operation of sharing an imagecaptured from an application execution screen, and execution pathinformation corresponding to the captured image according to anembodiment of the present disclosure.

Referring to FIG. 12, the electronic device 100 may determine inoperation 1210 whether a request for sharing an image captured from anapplication screen and execution path information is received from theuser.

Upon receiving a request for sharing a captured image and execution pathinformation corresponding to the captured image, the electronic device100 may generate data including the captured image and the executionpath information corresponding to the captured image in operation 1220.In accordance with an embodiment of the present disclosure, the dataincluding the captured image and the execution path informationcorresponding to the captured image may have a scrapbook file (SCC) dataformat, or a data format comprised of images and texts. In addition, thedata including the captured image and the execution path informationcorresponding to the captured image may have any sharable data format.

In operation 1230, the electronic device 100 may transmit the dataincluding the captured image and the execution path informationcorresponding to the captured image, in order to share the data.

In accordance with various embodiments of the present disclosure, theelectronic device 100 may share the data including the captured imageand the execution path information corresponding to the captured image,with another electronic device of the same user or an electronic deviceof another user, through a data sharing server. Accordingly, theelectronic device 100 may allow the user to execute the operation thatwas performed during the capture, using the captured image even inanother electronic device of the same user or an electronic device ofanother user.

In accordance with an embodiment of the present disclosure, the datasharing server may include a storage unit for storing the data includingthe captured image and the execution path information corresponding tothe captured image, the data being uploaded from a first electronicdevice, and a controller for downloading, if the data is uploaded, thestored data to a second electronic device that may access the datasharing server with the same account as that of the first electronicdevice.

FIG. 13 illustrates a system for sharing a captured image and executionpath information corresponding to the captured image according to afirst embodiment of the present disclosure.

Referring to FIG. 13, a first electronic device A1 1310 may share animage captured from an application execution screen and execution pathinformation corresponding to the captured image by synchronizing themwith a second electronic device A2 1320 through a first sharing server1330. The first sharing server 1330 may be a server for providingsynchronization between electronic devices having the same account, suchas, for example, an i-cloud server and the like. The second electronicdevice A2 1320 may be another electronic device of the same user as theuser of the first electronic device A1 1310, and may access the firstsharing server 1330 across a communication network 1301 using the sameaccount as that of the first electronic device A1 1310.

FIG. 14 illustrates an operation of a system for sharing a capturedimage and execution path information corresponding to the captured imageaccording to a first embodiment of the present disclosure.

Referring to FIG. 14, in operation 1402, the first electronic device A11310 may store an image captured from an application execution screenand execution path information corresponding to the captured image, asdata in a predetermined format.

In accordance with an embodiment of the present disclosure, the data ina predetermined format may be data in an SCC format, or data in a formatcomprised of images and texts. In addition, the data including thecaptured image and the execution path information corresponding to thecaptured image may have any sharable data format.

In accordance with an embodiment of the present disclosure, theexecution path information corresponding to the captured image mayinclude information for executing a state of the captured image. Theexecution path information corresponding to the captured image mayinclude metadata. The metadata may include a title corresponding to theapplication execution screen, a URL for restoring the applicationexecution screen, a text corresponding to the application executionscreen, a data file (e.g., a music file, a video file or an image file)corresponding to the application execution screen, drawing memoinformation corresponding to the application execution screen,handwriting recognition result information corresponding to theapplication execution screen, clip location information corresponding tothe application execution screen, and the like.

In accordance with an embodiment of the present disclosure, the metadatamay further include deep link information. The deep link information maybe information for directly accessing resources used on the applicationexecution screen. For example, the deep link information may be a directlink to the resources such as video, sound and image files related tothe application execution screen. In addition, the deep link informationmay be information for accessing a sub page in a main page on theapplication execution screen.

In operation 1404, the first electronic device A1 1310 may periodicallycheck a change in data. Upon detecting a change in data, the firstelectronic device A1 1310 may upload the data to the first sharingserver 1330 over a communication network 1301, in operation 1406.

In operation 1408, the first sharing server 1330 may store the datauploaded from the first electronic device A1 1310.

After storing the uploaded data, the first sharing server 1330 maydownload the data to the second electronic device A2 1320 that is set tobe synchronized with the first electronic device A1 1310, in operation1410.

In accordance with an embodiment of the present disclosure, the firstsharing server 1330 may download the data to the second electronicdevice A2 1320 using a push message scheme or a polling scheme.

In the case of the push message scheme, the first sharing server 1330may notify the second electronic device A2 1320 that the data is storedin the first sharing server 1330, using a push message, and the secondelectronic device A2 1320 may request the stored data from the firstsharing server 1330 in response to the push message. The first sharingserver 1330 may download the data to the second electronic device A21320 in response to the request for the stored data.

In the case of the polling scheme, the second electronic device A2 1320may periodically make a request for querying whether there is newlystored data in the first sharing server 1330, and in response to thequery request from the second electronic device A2 1320, if there isnewly stored data, the first sharing server 1330 may send a responsemessage indicating the presence of the newly stored data, and thendownload the newly stored data to the second electronic device A2 1320.

In operation 1412, the second electronic device A2 1320 may besynchronized with the first electronic device A1 1310 by storing thedownloaded data, making it possible to share the data. In accordancewith an embodiment of the present disclosure, the first electronicdevice A1 1310 may capture the entire web page screen from the webbrowser application execution screen (e.g., the web page screen) inresponse to a user input, or may obtain an image of at least a part ofthe captured web page screen by cropping a partial image from thecaptured web page screen. The first electronic device A1 1310 may sharethe image of at least a part of the captured web page screen andexecution path information corresponding to the image of at least a partof the captured web page screen, with the second electronic device A21320 through the first sharing server 1330.

For example, during display of the web page screen, the first electronicdevice A1 1310 may obtain an image of at least a part of the web page inresponse to a user input. In accordance with an embodiment of thepresent disclosure, the first electronic device A1 1310 may obtain animage of a captured web page screen by capturing a web page screen usingan application (e.g., a SmartClip application) for performing a capturefunction in response to a user input, or may obtain an image of at leasta part of the web page by cropping a partial image from the captured webpage screen. In the following description, the image of the captured webpage screen or the partial image cropped from the captured web pagescreen may be referred to as a captured image.

The first electronic device A1 1310 may obtain execution pathinformation corresponding to the captured image. The execution pathinformation corresponding to the captured image may include informationfor executing a state of the captured image. In accordance with anembodiment of the present disclosure, the execution path informationcorresponding to the captured image may include metadata. The metadatamay include a title corresponding to the web page, a URL for restoringthe web page, a text corresponding to the web page, a data file (e.g., amusic file, a video file or an image file) corresponding to the webpage, drawing memo information corresponding to the web page,handwriting recognition result information corresponding to the webpage, clip location information corresponding to the web page, and thelike. In accordance with an embodiment of the present disclosure, themetadata may further include deep link information. The deep linkinformation may be information for directly accessing resources used inthe web page. For example, the deep link information may be a directlink to the resources such as video, sound and image files related tothe web page. In addition, the deep link information may be informationfor accessing a sub page in a main page on the web page.

The first electronic device A1 1310 may store the captured web pageimage and the execution path information corresponding to the capturedweb page image, as data in a predetermined format. In accordance with anembodiment of the present disclosure, the data in a predetermined formatmay be data in an SCC format, or data in a format comprised of imagesand texts. In addition, the data including the captured image and theexecution path information corresponding to the captured image may haveany sharable data format.

The first electronic device A1 1310 may periodically check a change indata of the DB related to a scrapbook application. Upon detecting achange in data, the first electronic device A1 1310 may upload the dataincluding the captured web page image and the execution path informationcorresponding to the captured web page image to the first sharing server1330 over the communication network 1301. The first sharing server 1330may store the data uploaded from the first electronic device A1 1310.

After storing the uploaded data, the first sharing server 1330 maydownload the data including the captured web page image and theexecution path information corresponding to the captured web page imageto the second electronic device A2 1320 that is set to be synchronizedwith the first electronic device A1 1310.

In accordance with an embodiment of the present disclosure, the firstsharing server 1330 may download the data including the captured webpage image and the execution path information corresponding to thecaptured web page image to the second electronic device A2 1320 usingthe push message scheme or the polling scheme.

In the case of the push message scheme, the first sharing server 1330may notify the second electronic device A2 1320 that the data includingthe captured web page image and the execution path informationcorresponding to the captured web page image is stored in the firstsharing server 1330, using a push message, and the second electronicdevice A2 1320 may request the data including the captured web pageimage and the execution path information corresponding to the capturedweb page image, from the first sharing server 1330 in response to thepush message. The first sharing server 1330 may download the dataincluding the captured web page image and the execution path informationcorresponding to the captured web page image to the second electronicdevice A2 1320 in response to the request for the stored data.

In the case of the polling scheme, the second electronic device A2 1320may periodically make a request for querying whether there is newlystored data in the first sharing server 1330, and in response to thequery request from the second electronic device A2 1320, if there isnewly stored data, the first sharing server 1330 may send a responsemessage indicating the presence of the newly stored data, and thendownload the newly stored data including the captured web page image andthe execution path information corresponding to the captured web pageimage to the second electronic device A2 1320.

The second electronic device A2 1320 may be synchronized with the firstelectronic device A1 1310 by storing the downloaded data including thecaptured web page image and the execution path information correspondingto the captured web page image, making it possible to share the capturedweb page image and the execution path information corresponding to thecaptured web page image. The second electronic device A2 1320 maydisplay the captured web page image and the execution path informationcorresponding to the captured web page image, for the user, making itpossible to display the web page screen using the execution pathinformation corresponding to the captured web page image.

In accordance with an embodiment of the present disclosure, the firstelectronic device A1 1310 may capture a video playback serviceapplication execution screen from a video playback service applicationexecution screen (e.g., YouTube™ screen) in response to a user input, orobtain an image of at least a part of the captured video playbackservice application execution screen by cropping a partial image fromthe captured video playback service application execution screen. Thefirst electronic device A1 1310 may share the image of at least a partof the captured video playback service application execution screen andexecution path information corresponding to the image of at least a partof the captured video playback service application execution screen,with the second electronic device A2 1320 through the first sharingserver 1330.

In accordance with an embodiment of the present disclosure, the firstelectronic device A1 1310 may obtain a captured video playback servicescreen image by capturing a video playback service screen using anapplication (e.g., a SmartClip application) for performing a capturefunction during display of a video playback service applicationexecution screen, or may obtain an image of at least a part of thecaptured video playback service screen image by cropping a partial imagefrom the captured video playback service screen image. Herein, thecaptured video playback service screen image or the partial imagecropped from the captured video playback service screen may be referredto as a captured image.

The first electronic device A1 1310 may obtain execution pathinformation corresponding to the captured image. The execution pathinformation corresponding to the captured image may include informationfor executing a state of the captured image. In accordance with anembodiment of the present disclosure, the execution path informationcorresponding to the captured image may include metadata. The metadatamay include a title corresponding to the video playback service, a URLfor restoring the video playback service, a text corresponding to thevideo playback service, a data file (e.g., a music file, a video file oran image file) corresponding to the video playback service, drawing memoinformation corresponding to the video playback service, handwritingrecognition result information corresponding to the video playbackservice, clip location information corresponding to the video playbackservice, and the like. In accordance with an embodiment of the presentdisclosure, the metadata may further include deep link information. Thedeep link information may be information for directly accessingresources used in the video playback service screen. For example, thedeep link information may be a direct link to the resources such asvideo, sound and image files related to the video playback servicescreen. In addition, the deep link information may be information foraccessing a sub page in a main page on the video playback servicescreen.

The first electronic device A1 1310 may store an image of at least apart of the captured video playback service screen and execution pathinformation corresponding to the image of at least a part of thecaptured video playback service screen, as data in a predeterminedformat. In accordance with an embodiment of the present disclosure, thedata in a predetermined format may be data in an SCC format, or data ina format comprised of images and texts. In addition, the data includingthe captured image and the execution path information corresponding tothe captured image may have any sharable data format. In accordance withan embodiment of the present disclosure, the data in a predeterminedformat may be stored in a DB related to a scrapbook application.

The first electronic device A1 1310 may periodically check a change indata of the DB related to a scrapbook application. Upon detecting achange in data, the first electronic device A1 1310 may upload the dataincluding the image of at least a part of the captured video playbackservice screen and execution path information corresponding to the imageof at least a part of the captured video playback service screen, to thefirst sharing server 1330 over the communication network 1301. The firstsharing server 1330 may store the data uploaded from the firstelectronic device A1 1310. After storing the uploaded data, the firstsharing server 1330 may download the data including the image of atleast a part of the captured video playback service screen and theexecution path information corresponding to the image of at least a partof the captured video playback service screen, to the second electronicdevice A2 1320 that is set to be synchronized with the first electronicdevice A1 1310.

In accordance with an embodiment of the present disclosure, the firstsharing server 1330 may download the data including the image of atleast a part of the captured video playback service screen and theexecution path information corresponding to the image of at least a partof the captured video playback service screen, to the second electronicdevice A2 1320 using the push message scheme or the polling scheme.

In the case of the push message scheme, the first sharing server 1330may notify the second electronic device A2 1320 that the data is storedin the first sharing server 1330, using a push message, and the secondelectronic device A2 1320 may request the stored data from the firstsharing server 1330 in response to the push message. The first sharingserver 1330 may download the data including the image of at least a partof the captured video playback service screen and the execution pathinformation corresponding to the image of at least a part of thecaptured video playback service screen, to the second electronic deviceA2 1320 in response to the request for the stored data.

In the case of the polling scheme, the second electronic device A2 1320may periodically make a request for querying whether there is newlystored data in the first sharing server 1330, and in response to thequery request from the second electronic device A2 1320, if there isnewly stored data, the first sharing server 1330 may send a responsemessage indicating the presence of the newly stored data, and thendownload the newly stored data including the image of at least a part ofthe captured video playback service screen and the execution pathinformation corresponding to the image of at least a part of thecaptured video playback service screen, to the second electronic deviceA2 1320.

The second electronic device A2 1320 may be synchronized with the firstelectronic device A1 1310 by storing the downloaded data including theimage of at least a part of the captured video playback service screenand the execution path information corresponding to the image of atleast a part of the captured video playback service screen, making itpossible to share the image of at least a part of the captured videoplayback service screen and the execution path information correspondingto the image of at least a part of the captured video playback servicescreen. The second electronic device A2 1320 may display the image of atleast a part of the captured video playback service screen and theexecution path information corresponding to the image of at least a partof the captured video playback service screen, for the user, making itpossible to execute the video playback service using the execution pathinformation corresponding to the image of at least a part of thecaptured video playback service screen.

In accordance with an embodiment of the present disclosure, the firstelectronic device A1 1310 may obtain an image of at least a part of thecaptured music playback screen by capturing a music playback screen froma music playback application execution screen (e.g., a music playbackscreen) in response to a user input. The first electronic device A1 1310may obtain the entire image of the captured music playback screen, orobtain a partial image of the captured music playback screen by croppinga partial image from the captured music playback screen. The firstelectronic device A1 1310 may share the image of at least a part of thecaptured music playback screen and the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen, with the second electronic device A2 1320 through thefirst sharing server 1330.

In accordance with an embodiment of the present disclosure, the firstelectronic device A1 1310 may capture an image of at least a part of themusic playback screen using an application (e.g., a SmartClipapplication) for performing a capture function in response to a userinput during playback of music. In the following description, the entireimage of the captured music playback screen or a partial image croppedfrom the captured music playback screen may be referred to as a capturedimage.

The first electronic device A1 1310 may obtain execution pathinformation corresponding to the captured image. The execution pathinformation corresponding to the captured image may include informationfor executing a music playback state of the captured image. Inaccordance with an embodiment of the present disclosure, the executionpath information corresponding to the captured image may includemetadata. The metadata may include a title corresponding to the musicplayback screen, a URL for restoring a state of the music playbackscreen, a text corresponding to the music playback screen, a data file(e.g., a music file, a video file or an image file) corresponding to themusic playback screen, drawing memo information corresponding to themusic playback screen, handwriting recognition result informationcorresponding to the music playback screen, clip location informationcorresponding to the music playback screen, and the like. In accordancewith an embodiment of the present disclosure, the metadata may furtherinclude deep link information. The deep link information may beinformation for directly accessing resources used in the music playbackscreen. For example, the deep link information may be a direct link toan audio file related to the music playback screen. In addition, thedeep link information may be information for accessing a sub page in amain page on the music playback screen.

The first electronic device A1 1310 may store an image of at least apart of the captured music playback screen and execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen, as data in a predetermined format. Inaccordance with an embodiment of the present disclosure, the data in apredetermined format may be data in an SCC format, or data in a formatcomprised of images and texts. In addition, the data including thecaptured image and the execution path information corresponding to thecaptured image may have any sharable data format. In accordance with anembodiment of the present disclosure, the first electronic device A11310 may further include or insert, into the data, an audio filecorresponding to the music playback screen.

The first electronic device A1 1310 may periodically check a change indata of the DB related to a scrapbook application. Upon detecting achange in data, the first electronic device A1 1310 may upload the imageof at least a part of the captured music playback screen and theexecution path information corresponding to the image of at least a partof the captured music playback screen, to the first sharing server 1330over the communication network 1301. In accordance with an embodiment ofthe present disclosure, the first electronic device A1 1310 may uploadthe data that further includes the audio file in addition to the imageof at least a part of the captured music playback screen and theexecution path information corresponding to the image of at least a partof the captured music playback screen, to the first sharing server 1330over the communication network 1301. In accordance with an embodiment ofthe present disclosure, the audio file may be uploaded only when theaudio file's data size is less than or equal to a predetermined datasize. The predetermined data size may be, for example, 15 Mbytes.

The first sharing server 1330 may store the data uploaded from the firstelectronic device A1 1310. After storing the uploaded data, the firstsharing server 1330 may download the data including the image of atleast a part of the captured music playback screen and the executionpath information corresponding to the image of at least a part of thecaptured music playback screen or the data including the image of atleast a part of the captured music playback screen, the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen and the audio file, to the secondelectronic device A2 1320 that is set to be synchronized with the firstelectronic device A1 1310.

In accordance with an embodiment of the present disclosure, the firstsharing server 1330 may download the data including the image of atleast a part of the captured music playback screen and the executionpath information corresponding to the image of at least a part of thecaptured music playback screen or the data including the image of atleast a part of the captured music playback screen, the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen and the audio file, to the secondelectronic device A2 1320 using the push message scheme or the pollingscheme.

In the case of the push message scheme, the first sharing server 1330may notify the second electronic device A2 1320 that the data is storedin the first sharing server 1330, using a push message, and the secondelectronic device A2 1320 may request the stored data from the firstsharing server 1330 in response to the push message. The first sharingserver 1330 may download the data including the image of at least a partof the captured music playback screen and the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen or the data including the image of at least a part ofthe captured music playback screen, the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen and the audio file, to the second electronic device A21320 in response to the request for the stored data.

In the case of the polling scheme, the second electronic device A2 1320may periodically make a request for querying whether there is newlystored data in the first sharing server 1330, and in response to thequery request from the second electronic device A2 1320, if there isnewly stored data, the first sharing server 1330 may send a responsemessage indicating the presence of the newly stored data, and thendownload the newly stored data including the image of at least a part ofthe captured music playback screen and the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen or the newly stored data including the image of at leasta part of the captured music playback screen, the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen and the audio file, to the secondelectronic device A2 1320.

The second electronic device A2 1320 may download the data including theimage of at least a part of the captured music playback screen and theexecution path information corresponding to the image of at least a partof the captured music playback screen, or the data including the imageof at least a part of the captured music playback screen, the executionpath information corresponding to the image of at least a part of thecaptured music playback screen and the audio file, from the firstsharing server 1330. The second electronic device A2 1320 may besynchronized with the first electronic device A1 1310 by storing thedownloaded data including the image of at least a part of the capturedmusic playback screen and the execution path information correspondingto the image of at least a part of the captured music playback screen,or the downloaded data including the image of at least a part of thecaptured music playback screen, the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen and the audio file, making it possible to share theimage of at least a part of the captured music playback screen and theexecution path information corresponding to the image of at least a partof the captured music playback screen, or to share the image of at leasta part of the captured music playback screen, the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen, and the audio file. The secondelectronic device A2 1320 may display the image of at least a part ofthe captured music playback screen and the execution path informationcorresponding to the image of at least a part of the captured musicplayback screen, for the user, making it possible to play the musicusing the execution path information corresponding to the image of atleast a part of the captured music playback screen. Alternatively, thesecond electronic device A2 1320 may play the audio file.

In accordance with an embodiment of the present disclosure, the datasharing server may include a storage unit for storing the data includingthe captured image and the execution path information corresponding tothe captured image, the data being uploaded from a first electronicdevice, and a controller for transmitting, if the data is uploaded, aURL of the uploaded data to the first electronic device, allowing thefirst electronic device to forward the URL of the uploaded data to asecond electronic device, and for downloading the uploaded data to thesecond electronic device in response to a data request that the secondelectronic device has made using the URL of the uploaded data.

FIG. 15 illustrates a system for sharing a captured image and executionpath information corresponding to the captured image according to asecond embodiment of the present disclosure.

Referring to FIG. 15, a first electronic device A 1510 may upload dataincluding a captured image and execution path information correspondingto the captured image to a second sharing server 1530 over acommunication network 1501. The first electronic device A 1510 mayreceive a URL of the uploaded data from the second sharing server 1530,and provide the URL to a second electronic device B 1520.

The second sharing server 1530 may be, for example, a server thatprovides a cloud storage service, such as Dropbox™ and the like, and mayalso be a server that provides a service in which electronic devices mayupload and download data. If data is uploaded from the first electronicdevice A 1510, the second sharing server 1530 may provide a URL of theuploaded data to the first electronic device A 1510.

The second electronic device B 1520 may receive the URL of the datauploaded to the second sharing server 1530, from the first electronicdevice A 1510 over the communication network 1501. The second electronicdevice B 1520 may be an electronic device of a user different from theuser of the first electronic device A 1510, and may download datacorresponding to the URL of the uploaded data by accessing the secondsharing server 1530 using a different account from that of the firstelectronic device A 1510. The second electronic device B 1520 may sharethe data with the first electronic device A 1510 by storing thedownloaded data.

FIG. 16 illustrates an operation of a system for sharing a capturedimage and execution path information corresponding to the captured imageaccording to a second embodiment of the present disclosure.

Referring to FIG. 16, in operation 1602, the first electronic device A1510 may store an image captured from an application execution screenand execution path information corresponding to the captured image. Inaccordance with an embodiment of the present disclosure, the firstelectronic device A 1510 may store the captured image and the executionpath information corresponding to the captured image, as data in apredetermined format. In accordance with an embodiment of the presentdisclosure, the data in a predetermined format may be data in an SCCformat, or data in a format comprised of images and texts. In addition,the data including the captured image and the execution path informationcorresponding to the captured image may have any sharable data format.

In accordance with an embodiment of the present disclosure, theexecution path information corresponding to the captured image mayinclude metadata. The metadata may include a title corresponding to theapplication execution screen, a URL for restoring the applicationexecution screen, a text corresponding to the application executionscreen, a data file (e.g., a music file, a video file or an image file)corresponding to the application execution screen, drawing memoinformation corresponding to the application execution screen,handwriting recognition result information corresponding to theapplication execution screen, clip location information corresponding tothe application execution screen, and the like.

In accordance with an embodiment of the present disclosure, the metadatamay further include deep link information. The deep link information maybe information for directly accessing resources used on the applicationexecution screen. For example, the deep link information may be a directlink to the resources such as video, sound and image files related tothe application execution screen. In addition, the deep link informationmay be information for accessing a sub page in a main page on theapplication execution screen.

Upon receiving a data upload request made by the user in operation 1604,the first electronic device A 1510 may upload data to the second sharingserver 1530 in operation 1606.

The second sharing server 1530 store the uploaded data in operation1608, and transmit a URL of the uploaded data, which makes it possibleto access the uploaded data, to the first electronic device A 1510 inoperation 1610.

In operation 1612, the first electronic device A 1510 may receive asharing request for a URL of uploaded data from the user. Upon receivingthe sharing request for a URL of uploaded data, the first electronicdevice A 1510 may select a transmission scheme for a URL of uploadeddata in operation 1614. In accordance with an embodiment of the presentdisclosure, the transmission scheme for a URL of uploaded data mayinclude at least one of an email transmission scheme, a messagetransmission scheme (SMS, MMS and the like), a chat message transmissionscheme (e.g., ChatOn and the like), and a WIFI Direct transmissionscheme. In addition, the transmission scheme may include anytransmission scheme that may transmit a URL. In operation 1616, thefirst electronic device A 1510 may transmit the URL of the uploaded datato the second electronic device B 1520 using the selected transmissionscheme.

Upon receiving the URL of the uploaded data, the second electronicdevice B 1520 may access the URL of the uploaded data in operation 1618,and download the uploaded data from the second sharing server 1530 inoperation 1620. In operation 1622, the second electronic device B 1520may share the data with the first electronic device A 1510 by storingthe downloaded data.

In accordance with an embodiment of the present disclosure, if a webbrowser application execution screen (e.g., a web page screen) iscaptured, or if a partial image of the web page screen is captured bycropping an image of at least a part of the web page screen, the firstelectronic device A 1510 may upload data including the captured imageand execution path information corresponding to the captured image, tothe second sharing server 1530, receive a URL of the uploaded data fromthe second sharing server 1530, and provide the received URL to thesecond electronic device B 1520. For example, the first electronicdevice A 1510 may capture an image of at least a part of the web pagescreen in response to a user input during the display of the web pagescreen. In accordance with an embodiment of the present disclosure, thefirst electronic device A 1510 may capture an image of at least a partof the web page using an application (e.g., a SmartClip application) forperforming a capture function in response to a user input. The firstelectronic device A 1510 may obtain execution path informationcorresponding to the captured image. The execution path informationcorresponding to the captured image may include information forexecuting a state of the captured image. In accordance with anembodiment of the present disclosure, the execution path informationcorresponding to the captured image may include metadata. The metadatamay include a title corresponding to the web page, a URL for restoringthe web page, a text corresponding to the web page, a data file (e.g., amusic file, a video file or an image file) corresponding to the webpage, drawing memo information corresponding to the web page,handwriting recognition result information corresponding to the webpage, clip location information corresponding to the web page, and thelike. In accordance with an embodiment of the present disclosure, themetadata may further include deep link information. The deep linkinformation may be information for directly accessing resources used inthe web page. For example, the deep link information may be a directlink to the resources such as video, sound and image files related tothe web page. In addition, the deep link information may be informationfor accessing a sub page in a main page on the web page.

The first electronic device A 1510 may store the captured web page imageand the execution path information corresponding to the captured webpage image, as data in a predetermined format.

In accordance with an embodiment of the present disclosure, the data ina predetermined format may be data in an SCC format, or data in a formatcomprised of images and texts. In addition, the data including thecaptured image and the execution path information corresponding to thecaptured image may have any sharable data format. In accordance with anembodiment of the present disclosure, the data in a predetermined formatmay be stored in a DB related to a scrapbook application. The firstelectronic device A 1510 may receive the data to be uploaded to thesecond sharing server 1530, which is selected by the user from the datastored in the DB related to the scrapbook application. In accordancewith an embodiment of the present disclosure, the first electronicdevice A 1510 may provide an option of allowing the user to select datato be uploaded. If the data to be uploaded is selected by the user, thefirst electronic device A 1510 may upload the data to the second sharingserver 1530, and request a URL of the uploaded data. The second sharingserver 1530 may store the uploaded data, generate a URL of the uploadeddata, which makes it possible to access the uploaded data, and deliverthe URL to the first electronic device A 1510. The first electronicdevice A 1510 may receive a sharing request for a URL of uploaded datafrom the user. Upon receiving the sharing request for a URL of uploadeddata, the first electronic device A 1510 may select a sharing scheme fora URL of uploaded data. In accordance with an embodiment of the presentdisclosure, the sharing scheme for a URL of uploaded data may include atleast one of an email transmission scheme, a message transmission scheme(SMS, MMS and the like), a chat message transmission scheme (e.g.,ChatOn and the like), and a WIFI Direct transmission scheme. Inaddition, the transmission scheme may include any transmission schemethat may transmit a URL. The first electronic device A 1510 may transmitthe URL of the uploaded data to the second electronic device B 1520using the selected transmission scheme. The second electronic device B1520 may receive a message including the URL of the uploaded data. Thesecond electronic device B 1520 may execute a web browser application toaccess the URL of the uploaded data, and may access the URL of theuploaded data and download the data including the captured web pageimage and the execution path information corresponding to the capturedweb page image. The second electronic device B 1520 may store andexecute the downloaded data including the captured web page image andthe execution path information corresponding to the captured web pageimage. In accordance with an embodiment of the present disclosure, thesecond electronic device B 1520 may store the data including thecaptured web page image and the execution path information correspondingto the captured web page image, which is downloaded in a scrapbookapplication DB, and may display the web page screen using the executionpath information corresponding to the web page image captured by thescrapbook application.

In accordance with an embodiment of the present disclosure, if a partialimage is captured during the display of a video playback serviceapplication execution screen (e.g., a YouTube™ screen), the firstelectronic device A 1510 may upload data including the image of at leasta part of the captured video playback service screen and the executionpath information corresponding to the image of at least a part of thecaptured video playback service screen, to the second sharing server1530 over the communication network 1501, and may receive a URL of theuploaded data from the second sharing server 1530 and provide the URL tothe second electronic device B 1520.

For example, the first electronic device A 1510 may capture an image ofat least a part of the video playback service screen using anapplication for performing a capture function in response to a userinput. In the following description, the captured video playback servicescreen image or the partial image cropped from the captured videoplayback service screen image may be referred to as a captured image.

The first electronic device A 1510 may obtain execution path informationcorresponding to the captured image. The execution path informationcorresponding to the captured image may include information forexecuting a state of the captured image. In accordance with anembodiment of the present disclosure, the execution path informationcorresponding to the captured image may include metadata. The metadatamay include a title corresponding to the video playback service, a URLfor restoring the video playback service, a text corresponding to thevideo playback service, a data file (e.g., a music file, a video file oran image file) corresponding to the video playback service, drawing memoinformation corresponding to the video playback service, handwritingrecognition result information corresponding to the video playbackservice, clip location information corresponding to the video playbackservice, and the like. In accordance with an embodiment of the presentdisclosure, the metadata may further include deep link information. Thedeep link information may be information for directly accessing videosused on the video playback service screen. For example, the deep linkinformation may be a direct link to the video files related to the videoplayback service screen. In addition, the deep link information may beinformation for accessing a sub page in a main page on the videoplayback service screen.

The first electronic device A 1510 may store an image of at least a partof the captured video playback service screen and execution pathinformation corresponding to the image of at least a part of thecaptured video playback service screen, as data in a predeterminedformat. In accordance with an embodiment of the present disclosure, thedata in a predetermined format may be data in an SCC format, or data ina format comprised of images and texts. In addition, the data includingthe captured image and the execution path information corresponding tothe captured image may have any sharable data format.

The first electronic device A 1510 may receive the data (e.g., the dataincluding the image of at least a part of the captured video playbackservice screen and the execution path information corresponding to theimage of at least a part of the captured video playback service screen)to be uploaded to the second sharing server 1530, which is selected bythe user from the data stored in the DB related to the scrapbookapplication. In accordance with an embodiment of the present disclosure,the first electronic device A 1510 may provide an option of allowing theuser to select data to be uploaded. If the data to be uploaded isselected by the user, the first electronic device A 1510 may upload thedata to the second sharing server 1530, and request a URL of theuploaded data. The second sharing server 1530 may store the uploadeddata, generate a URL of the uploaded data, which makes it possible toaccess the uploaded data, and deliver the URL to the first electronicdevice A 1510. The first electronic device A 1510 may receive a sharingrequest for a URL of uploaded data from the user. Upon receiving thesharing request for a URL of uploaded data, the first electronic deviceA 1510 may select a sharing scheme for a URL of uploaded data. Inaccordance with an embodiment of the present disclosure, the sharingscheme for a URL of uploaded data may include at least one of an emailtransmission scheme, a message transmission scheme (SMS, MMS and thelike), a chat message transmission scheme (e.g., ChatOn and the like),and a WIFI Direct transmission scheme. In addition, the transmissionscheme may include any transmission scheme that may transmit a URL. Thefirst electronic device A 1510 may transmit the URL of the uploaded datato the second electronic device B 1520 using the selected transmissionscheme. The second electronic device B 1520 may receive a messageincluding the URL of the uploaded data. The second electronic device B1520 may execute a web browser application to access the URL of theuploaded data, and may access the URL of the uploaded data through theweb browser, and download the data including the image of at least apart of the captured video playback service screen and the executionpath information corresponding to the image of at least a part of thecaptured video playback service screen. The second electronic device B1520 may store and execute the downloaded data including the image of atleast a part of the captured video playback service screen and theexecution path information corresponding to the image of at least a partof the captured video playback service screen. In accordance with anembodiment of the present disclosure, the second electronic device B1520 may store the image of at least a part of the captured videoplayback service screen and the execution path information correspondingto the image of at least a part of the captured video playback servicescreen, which are downloaded in a scrapbook application DB, and maydisplay the video service screen using the execution path informationcorresponding to the image of at least a part of the video playbackservice screen captured by the scrapbook application.

In accordance with an embodiment of the present disclosure, if an imageof at least a part of, for example, the music playback screen iscaptured during the display of a music playback application executionscreen, the first electronic device A 1510 may upload the data includingthe image of at least a part of the captured music playback screen andthe execution path information corresponding to the image of at least apart of the captured music playback screen, to the second sharing server1530, and may receive a URL of the uploaded data from the second sharingserver 1530 and provide the URL to the second electronic device B 1520.

For example, the first electronic device A 1510 may capture an image ofat least a part of the music playback application execution screen usingan application for performing a capture function in response to a userinput. In the following description, the entire image of the capturedmusic playback screen or a partial image cropped from the captured musicplayback screen may be referred to as a captured image.

The first electronic device A 1510 may obtain execution path informationcorresponding to the captured image. The execution path informationcorresponding to the captured image may include information forexecuting a state of the captured image. In accordance with anembodiment of the present disclosure, the execution path informationcorresponding to the captured image may include metadata. The metadatamay include a title corresponding to the music playback screen, a URLfor restoring the music playback screen, a text corresponding to themusic playback screen, a data file (e.g., a music file, a video file oran image file) corresponding to the music playback screen, drawing memoinformation corresponding to the music playback screen, handwritingrecognition result information corresponding to the music playbackscreen, clip location information corresponding to the music playbackscreen, and the like. In accordance with an embodiment of the presentdisclosure, the metadata may further include deep link information. Thedeep link information may be information for directly accessing a musicfile used on the music playback screen. For example, the deep linkinformation may be a direct link to the resources such as video, soundand image files related to the music playback screen. In addition, thedeep link information may be information for accessing a sub page in amain page on the music playback screen.

The first electronic device A 1510 may store the image of at least apart of the captured music playback screen and the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen, as data in a predetermined form. Inaccordance with an embodiment of the present disclosure, the firstelectronic device A 1510 may include or insert the original audio filecorresponding to the music playback screen into the data together withthe image of at least a part of the captured music playback screen andthe execution path information corresponding to the image of at least apart of the captured music playback screen. In accordance with anembodiment of the present disclosure, the data in a predetermined formatmay be data in an SCC format, or data in a format comprised of imagesand texts. In addition, the data including the captured image and theexecution path information corresponding to the captured image may haveany sharable data format. In accordance with an embodiment of thepresent disclosure, the data in a predetermined format may be stored ina DB related to a scrapbook application.

The first electronic device A 1510 may receive the data (e.g., the dataincluding the image of at least a part of the captured music playbackscreen and the execution path information corresponding to the image ofat least a part of the captured music playback screen or the dataincluding the image of at least a part of the captured music playbackscreen, the execution path information corresponding to the image of atleast a part of the captured music playback screen and the audio file)to be uploaded to the second sharing server 1530, which is selected bythe user from the data stored in the DB related to the scrapbookapplication. In accordance with an embodiment of the present disclosure,the first electronic device A 1510 may provide an option of allowing theuser to select data to be uploaded. If the data to be uploaded isselected by the user, the first electronic device A 1510 may upload thedata to the second sharing server 1530, and request a URL of theuploaded data. The second sharing server 1530 may store the uploadeddata, generate a URL of the uploaded data, which makes it possible toaccess the uploaded data, and deliver the URL to the first electronicdevice A 1510. The first electronic device A 1510 may receive a sharingrequest for a URL of uploaded data from the user. Upon receiving thesharing request for a URL of uploaded data, the first electronic deviceA 1510 may select a sharing scheme for a URL of uploaded data. Inaccordance with an embodiment of the present disclosure, the sharingscheme for a URL of uploaded data may include at least one of an emailtransmission scheme, a message transmission scheme (SMS, MMS and thelike), a chat message transmission scheme (e.g., ChatOn and the like),and a WIFI Direct transmission scheme. In addition, the transmissionscheme may include any transmission scheme that may transmit a URL. Thefirst electronic device A 1510 may transmit the URL of the uploaded datato the second electronic device B 1520 using the selected transmissionscheme. The second electronic device B 1520 may receive a messageincluding the URL of the uploaded data. The second electronic device B1520 may execute a web browser application to access the URL of theuploaded data, and may access the URL of the uploaded data through theweb browser, and download the data including the image of at least apart of the captured music playback screen and the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen, or the data including the image of atleast a part of the captured music playback screen, the execution pathinformation corresponding to the image of at least a part of thecaptured music playback screen, and the audio file. The secondelectronic device B 1520 may store and execute the downloaded dataincluding the image of at least a part of the captured music playbackscreen and the execution path information corresponding to the image ofat least a part of the captured music playback screen, or the downloadeddata further including the audio file. In accordance with an embodimentof the present disclosure, the second electronic device B 1520 may storethe data including the image of at least a part of the captured musicplayback screen and the execution path information corresponding to theimage of at least a part of the captured music playback screen, which isdownloaded in a scrapbook application DB, and may play the music usingthe execution path information corresponding to the image of at least apart of the music playback screen captured by the scrapbook application.

FIG. 17 illustrates the concept of sharing a captured image andexecution path information corresponding to the captured image accordingto a third embodiment of the present disclosure.

Referring to FIG. 17, a first electronic device A 1710 may share dataincluding an image that is captured from an application execution screenduring the execution of an application, and execution path informationcorresponding to the captured image, by directly delivering the data toa second electronic device B 1720 over a communication network 1701. Inaccordance with an embodiment of the present disclosure, the firstelectronic device A 1710 may deliver the data including the capturedimage and the execution path information corresponding to the capturedimage to the second electronic device B 1720 as the captured image'soriginal data in a format comprised of images and texts, or may deliverthe data including the captured image and the execution path informationcorresponding to the captured image by converting the data into data ina predetermined format (e.g., an SCC format).

FIG. 18 illustrates an operation of sharing a captured image andexecution path information corresponding to the captured image betweenelectronic devices according to a third embodiment of the presentdisclosure.

Referring to FIG. 18, in operation 1802, the first electronic device A1710 may store the data including an image captured from an applicationexecution screen and execution path information corresponding to thecaptured image. In accordance with an embodiment of the presentdisclosure, the first electronic device A 1710 may store the capturedimage and the execution path information corresponding to the capturedimage, as data in a predetermined format. In accordance with anembodiment of the present disclosure, the data in a predetermined formatmay be data in an SCC format, or data in a format comprised of imagesand texts. In addition, the data including the captured image and theexecution path information corresponding to the captured image may haveany sharable data format.

In accordance with an embodiment of the present disclosure, theexecution path information corresponding to the captured image mayinclude metadata. The metadata may include a title corresponding to theapplication execution screen, a URL for restoring the applicationexecution screen, a text corresponding to the application executionscreen, a data file (e.g., a music file, a video file or an image file)corresponding to the application execution screen, drawing memoinformation corresponding to the application execution screen,handwriting recognition result information corresponding to theapplication execution screen, clip location information corresponding tothe application execution screen, and the like. In accordance with anembodiment of the present disclosure, the metadata may further includedeep link information. The deep link information may be information fordirectly accessing resources used on the application execution screen.For example, the deep link information may be a direct link to theresources such as video, sound and image files related to theapplication execution screen. In addition, the deep link information maybe information for accessing a sub page in a main page on theapplication execution screen.

In operation 1804, the first electronic device A 1710 may receive asharing request for the data including the captured image and theexecution path information corresponding to the captured image, thesharing request being made by a user input.

Upon receiving the data sharing request from the user, the firstelectronic device A 1710 may select a data sharing scheme in operation1806. In accordance with an embodiment of the present disclosure, thefirst electronic device A 1710 may determine whether to share the dataincluding the captured image and the execution path informationcorresponding to the captured image as the captured image's originaldata, or whether to share the data including the captured image and theexecution path information corresponding to the captured image byconverting the data into data in a predetermined format. In accordancewith an embodiment of the present disclosure, if the data is shared asthe data's original data, the first electronic device A 1710 may sharethe original captured image (e.g., an image in a PNG format or an imagein a JPG format), and the execution path information corresponding tothe captured image in a text format. If the data is shared by convertingthe data into data in a predetermined format, the first electronicdevice A 1710 may share the original captured image (e.g., an image in aPNG format or an image in a JPG format) and the execution pathinformation corresponding to the captured image by converting them intoone file (e.g., an SCC file).

In operation 1808, the first electronic device A 1710 may select a datatransmission scheme. In accordance with an embodiment of the presentdisclosure, the first electronic device A 1710 may allow the user toselect any one of a plurality of data transmission schemes, for the dataincluding the captured image and the execution path informationcorresponding to the captured image. In accordance with an embodiment ofthe present disclosure, the data transmission scheme may be at least oneof various transmission schemes such as an email transmission scheme, amessage transmission scheme (SMS, MMS and the like), a chat messagetransmission scheme (e.g., ChatOn and the like), a WIFI Directtransmission scheme and the like. In addition, the data transmissionscheme may include any scheme that may transmit data.

In operation 1810, the first electronic device A 1710 may transmit thedata including the captured image and the execution path informationcorresponding to the captured image to the second electronic device B1720. In accordance with an embodiment of the present disclosure, thefirst electronic device A 1710 may transmit the data including thecaptured image and the execution path information corresponding to thecaptured image to the second electronic device B 1720 using the selecteddata sharing scheme and the selected data transmission scheme.

In operation 1812, the second electronic device B 1720 may receive andstore the data including the captured image and the execution pathinformation corresponding to the captured image from the firstelectronic device A 1710, thereby sharing the data including thecaptured image and the execution path information corresponding to thecaptured image with the first electronic device A 1710.

In accordance with various embodiments of the present disclosure, theelectronic device 100 may provide a variety of user interface screens toshare the captured image and the execution path informationcorresponding to the captured image.

FIGS. 19A to 22D illustrate user interface screens for sharing acaptured image and execution path information corresponding to thecaptured image in an electronic device according to an embodiment of thepresent disclosure.

Referring to FIGS. 19A to 19C, the electronic device 100 may displaydata (hereinafter referred to as ‘scrap data’) 1912 including imagescaptured from a scrapbook application execution screen 1910 andexecution path information corresponding to the captured images asillustrated in FIG. 19A. The user may select scrap data 1914 that theuser desires to share, from among the scrap data 1912 displayed on thescrapbook application execution screen 1910.

If the scrap data that the user desires to share is selected by theuser, the electronic device 100 may display a scrap data screen 1920indicating a captured image 1924 of the selected scrap data andexecution path information 1922 corresponding to the captured image asillustrated in FIG. 19B. On the scrap data screen 1920 may be furtherdisplayed an input window 1926 in which the user may add tag informationto the scrap data, and a share icon 1928 by which the user may requestsharing of scrap data.

If the share icon 1928 is selected by the user, the electronic device100 may display a file format selection window 1930 through which theuser may select the file format in which the scrap data is to be shared,as illustrated in FIG. 19C. The file format selection window 1930 mayinclude file formats such as a file format 1932 consisting of images andtexts, and a SCC format 1934, and the like. The user may select the fileformat of the scrap data in the file format selection window 1930.

Referring to FIGS. 20A to 20C, the electronic device 100 may allow theuser to select a file format 2012 consisting of images and texts in afile format selection window 2010 as illustrated in FIG. 20A. If thefile format 2012 consisting of images and texts is selected, theelectronic device 100 may display a transmission scheme selection window2020 through which the user may select a scrap data transmission scheme,as illustrated in FIG. 20B. In the transmission scheme selection window2020 may be displayed icons corresponding to various transmissionschemes such as an email transmission scheme, a message transmissionscheme (SMS, MMS and the like), a chat message transmission scheme(e.g., ChatOn and the like), a WIFI Direct transmission scheme and thelike. The user may select a transmission scheme of the scrap data in thetransmission scheme selection window 2020. If a message transmissionscheme 2022 is selected from the various transmission schemes, theelectronic device 100 may execute a message transmission application anddisplay a message transmission application screen 2030 as illustrated inFIG. 20C. The electronic device 100 may include or insert the scrap datain an attachment area 2034 on the message transmission applicationscreen 2030, and may receive a user's message through a message writingarea 2032 and transmit the scrap data to a target electronic device withwhich the electronic device 100 will share the scrap data, using themessage transmission scheme.

Referring to FIGS. 21A to 21C, the electronic device 100 may allow theuser to select an SCC format 2014 in a file format selection window 2110as illustrated in FIG. 21A. If the SCC format 2014 is selected, theelectronic device 100 may display a transmission scheme selection window2120 through which the user may select a scrap data transmission scheme,as illustrated in FIG. 21B. In the transmission scheme selection window2120 may be displayed icons corresponding to various transmissionschemes such as an email transmission scheme, a message transmissionscheme (SMS, MMS and the like), a chat message transmission scheme(e.g., ChatOn and the like), a WIFI Direct transmission scheme and thelike. The user may select a transmission scheme of the scrap data in thetransmission scheme selection window 2120. If an email transmissionscheme 2122 is selected from the various transmission schemes, theelectronic device 100 may execute an email transmission application anddisplay an email transmission application screen 2130 as illustrated inFIG. 21C. The electronic device 100 may include or insert the scrap datain an attachment area 2132 on the email transmission application screen2130, and may receive the email contents from the user through an emailwriting area 2134 and transmit the scrap data to a target electronicdevice with which the electronic device 100 will share the scrap data,using the email transmission scheme.

Referring to FIGS. 22A to 22D, the electronic device 100 may receive andstore scrap data from another electronic device using varioustransmission schemes, thereby sharing the scrap data. In accordance withan embodiment of the present disclosure, upon receiving scrap datathrough the email transmission scheme, the electronic device 100 maystore scrap data 2212 included in an attached file on an email receptionscreen 2210 by selecting a Save button 2214 as illustrated in FIG. 22A.If the Save button 2214 for scrap data is selected, the electronicdevice 100 may store scrap data 2222 through a data storage screen 2220as illustrated in FIG. 22B. If the stored scrap data 2222 is selected,the electronic device 100 may display a category selection screen 2230through which the user may select a category in which the user willstore the scrap data, as illustrated in FIG. 22C. If a category 2232(e.g., ‘New’) is selected by the user on the category selection screen2230, the electronic device 100 may store scrap data 2242 in the ‘New’category as illustrated on a screen 2240 in FIG. 22D, thereby sharingthe scrap data 2242 with a receiving electronic device.

In accordance with an embodiment of the present disclosure, the scrapdata may correspond to an SCC file.

FIG. 23 illustrates an SCC file structure according to an embodiment ofthe present disclosure.

Referring to FIG. 23, an SCC file may be a file such as ‘fileName.SCC’2310. The SCC file may include ‘mimetype’ 2312, ‘appname’ 2314,‘appicon.png’ 2316, ‘thumbnail.png’ 2318, ‘META-INF’ 2320, ‘CONTENTS’2330, and ‘HTML’ 2340.

The ‘mimetype’ 2312 may be information indicating a name of eachapplication. For example, the ‘mimetype’ 2312, which is informationobtained by attaching a name of each application to the back of a prefixgiven as ‘application/vnd.samsung.SCC.’, may be‘Scrapbook:application/vnd.samsung.SCC.pinall’.

The ‘appname’ 2314, which is a text file without an extension, may be anapplication name corresponding to scrap data. An application name may bedisplayed in an integrated viewer.

The ‘appicon.png’ 2316 may be an icon file of an application, whichcorresponds to the scrap data. The icon may be displayed in theintegrated viewer.

The ‘thumbnail.png’ 2318 may be a thumbnail image of the scrap data. Theimage file may also be a ‘jpg’ file other than the ‘png’ file.

The ‘META-INF’ 2320, which is information about the location wheremetadata is stored, may include metadata. The information about thelocation where metadata is stored may be provided to the application.The metadata may have a format of XML and JavaScript Object Notation(JSON) files. Configuration of each of the XML and JSON files and aformat in the files may be defined in each application.

The ‘CONTENTS’ 2330 may correspond to the location where the originalmultimedia files are stored, and the original files of, for example,image, audio and video files may be linked through relative paths in aHyperText Markup Language (HTML) file.

The ‘HTML’ 2340 may correspond to an HTML file and the resources (e.g.,font, scc, js and the like) that are used in the HTML file so that ascreen may be configured in the integrated viewer. An HTML folder mayinclude index.html which is an essential file, and other additionallyrequired html files may also be stored therein. HTML may comply with theHTML5 standard or the SCC standard, and support JavaScript.

FIG. 24 illustrates META-INF 2320 included in an SCC file according toan embodiment of the present disclosure.

Referring to FIG. 24, the META-INF 2320 may be configured in a JSON filestructure. The META-INF 2320 may include a category name 2402, a contentstart (e.g., a start of scrap data) 2404, a content type (e.g., a typeof scrap data) 2406, a thumbnail image path 2408, a captured image path2410, a captured image width 2412, a captured image height 2414, animage-captured time 2416, a captured image's crop shape 2418 (e.g., 0:scribble, 1: square, 2: auto-calibration during scribbling, 3: croppingby scrapbooker, and the like), and metadata 2420 including a meta key2422.

FIG. 25 illustrates metadata according to an embodiment of the presentdisclosure.

Referring to FIG. 25, the metadata may be divided into a meta key 2510,a meta value 2520, and a meta value type 2530. The meta key 2510 may bea key indicating the type of the metadata. The meta value 2520 may be avalue corresponding to the key indicating the type of each metadata. Themeta value type 2530 may be a data type of the key indicating the typeof the metadata. In accordance with an embodiment of the presentdisclosure, the key indicating the type of the metadata may include‘title’, ‘plain_text’, ‘app_deep_link’, ‘url’, ‘file_path_audio’,‘file_path_video’, ‘file_path_image’, ‘file_path_drawing_memo’,‘file_path_spd’, ‘dm_hand_write_text’, and ‘location’.

The ‘title’ may be a title corresponding to an application executionscreen corresponding to the captured image. The ‘plain_text’ may be atext corresponding to the captured image. The ‘app_deep_link’ may be aURL for restoring an application execution screen corresponding to thecaptured image. The ‘url’ may be url information obtained from thecaptured image. The ‘file_path_audio’, ‘file_path_video’, or‘file_path_image’ may be a path of the original data file (e.g., audiofile, video file or image file) related to an application executionscreen corresponding to the captured image. The ‘file_path_drawing_memo’may be drawing memo information corresponding to the captured image. The‘file_path_spd’ may be drawing memory path information. The‘dm_hand_write_text’ may be handwriting recognition result informationcorresponding to the captured image. The ‘location’ may be clip locationinformation corresponding to the captured image.

In accordance with the above-described various embodiments of thepresent disclosure, an electronic device of a user may share thecaptured screen image and execution path information used for executingthe screen that was displayed during the screen capture, with anotherelectronic device of the same user or an electronic device of anotheruser, thereby making it possible to execute the screen that wasdisplayed during the screen capture using the captured screen image evenin another electronic device of the same user or an electronic device ofanother user.

The methods according to various embodiments of the present disclosuremay be implemented in the form of program commands that may be executedthrough various computer means, and then written in a computer-readablerecording medium. The computer-readable recording medium may includeprogram commands, data files, data structure and the like alone or incombination. The program commands written in the medium may be programcommands that are designed and configured especially for the presentdisclosure, or program commands that are known to those skilled in theart of the computer software.

It may be appreciated that the method for using a captured imageaccording to an embodiment of the present disclosure may be implementedin the form of hardware, software or a combination thereof. The softwaremay be stored in a volatile or non-volatile storage (e.g.,erasable/re-writable ROM), a memory (e.g., RAM, memory chip, memorydevice, memory Integrated Circuit (IC), or the like), or an optically ormagnetically recordable machine (e.g., computer)-readable storage medium(e.g., CD, DVD, magnetic disk, magnetic tape and the like). The methodfor using a captured image according to an embodiment of the presentdisclosure may be implemented by a computer or an electronic device,which includes a controller and a memory. It will be apparent to thoseof ordinary skill in the art that the memory may be an example of amachine-readable storage medium suitable to store a program (orprograms) including instructions for implementing embodiments of thepresent disclosure. Therefore, embodiments of the present disclosure mayinclude a program including codes for implementing the apparatus andmethod as defined by the appended claims, and a machine (or computer andthe like)-readable storage medium storing the program.

As is apparent from the foregoing description, in accordance withvarious embodiments of the present disclosure, if a user captures ascreen while watching screens associated with execution of anapplication, the electronic device may store an image of the entire orat least a part of the captured screen together with execution pathinformation for executing a state of the captured screen, thereby makingit possible for the user to execute the state of the captured screenusing the captured screen.

For example, if the user selects an image of the entire or at least apart of the stored web page screen, the electronic device may execute astate of the web page screen, so the user may omit the user inputoperation of executing a web browser to execute a state of the web pagescreen and entering a web page address on the web browser. If the userselects an image of the entire or at least a part of the stored musicplayback screen, the electronic device may execute a state of the musicplayback screen, so the user may omit the user input operation ofexecuting a music playback application to execute a state of the musicplayback screen and selecting music to be played in the music playbackapplication. If the user selects an image of the entire or at least apart of the stored clip screen image, the electronic device may executea state of the clip screen, so the user may omit the user inputoperation of executing a clip application to display a clip screen andselecting a clip screen to be displayed in the clip application.

In accordance with various embodiments of the present disclosure, anelectronic device of a user may share the captured screen image andexecution path information used for executing the screen that wasdisplayed during the screen capture, with another electronic device ofthe same user or an electronic device of another user, thereby making itpossible to execute the screen that was displayed during the screencapture using the captured screen image even in another electronicdevice of the same user or an electronic device of another user.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a displayconfigured to display an application execution screen; and a controllerconfigured to, when a screen image of the application execution screenis captured, obtain execution path information for executing a state ofthe captured screen image, and to store the captured screen image andthe execution path information.
 2. The electronic device of claim 1,wherein the execution path information comprises metadata.
 3. Theelectronic device of claim 2, wherein the metadata comprises at leastone of a title corresponding to the application execution screen, aUniform Resource Locator (URL) for restoring the application executionscreen, a text corresponding to the application execution screen, acontent file corresponding to the application execution screen, drawingmemo information corresponding to the application execution screen,handwriting recognition result information corresponding to theapplication execution screen, and clip location informationcorresponding to the application execution screen.
 4. The electronicdevice of claim 3, wherein the metadata further comprises deep linkinformation, and wherein the deep link information comprises informationfor directly accessing resources used on the application executionscreen.
 5. The electronic device of claim 4, wherein the deep linkinformation further comprises information for accessing a sub page in amain page on the application execution screen.
 6. The electronic deviceof claim 1, further comprising: a communication unit configured totransmit the captured screen image and the execution path information toshare the captured screen image and the execution path information. 7.The electronic device of claim 1, wherein the captured screen imagecomprises one of an entire image of the captured screen and a partialimage of the captured screen.
 8. The electronic device of claim 7,wherein the partial image of the captured screen comprises at least oneof an image of an object included in the captured screen, and an imageincluded in a closed circle by a user's drawing input on the capturedscreen.
 9. The electronic device of claim 1, wherein the captured screenimage and the execution path information are stored as data in apredetermined format.
 10. The electronic device of claim 9, wherein thedata in the predetermined format is data in one of a scrapbook file(SCC) format and a format comprised of an image and a text.
 11. Theelectronic device of claim 1, wherein the application comprises at leastone of a web browser application, a multimedia content playbackapplication, and a clip application.
 12. A method for using a capturedscreen in an electronic device, the method comprising: capturing ascreen image of an application execution screen; obtaining executionpath information for executing a state of the captured screen image; andstoring the captured screen image and the execution path information.13. The method of claim 12, wherein the execution path informationcomprises metadata.
 14. The method of claim 13, wherein the metadatacomprises at least one of a title corresponding to the applicationexecution screen, a Uniform Resource Locator (URL) for restoring theapplication execution screen, a text corresponding to the applicationexecution screen, a content file corresponding to the applicationexecution screen, drawing memo information corresponding to theapplication execution screen, handwriting recognition result informationcorresponding to the application execution screen, and clip locationinformation corresponding to the application execution screen.
 15. Themethod of claim 14, wherein the metadata further comprises deep linkinformation, and wherein the deep link information comprises informationfor directly accessing resources used on the application executionscreen.
 16. The method of claim 15, wherein the deep link informationfurther comprises information for accessing a sub page in a main page onthe application execution screen.
 17. The method of claim 12, furthercomprising transmitting the captured screen image and the execution pathinformation to share the captured screen image and the execution pathinformation.
 18. The method of claim 17, wherein the transmitting of thecaptured screen image and the execution path information comprises:selecting a data format of data including the captured screen image andthe execution path information; selecting a transmission scheme of thedata including the captured screen image and the execution pathinformation; and transmitting the data including the captured screenimage and the execution path information according to the selected dataformat and the selected transmission scheme.
 19. The method of claim 18,wherein the transmission scheme is one of an email transmission scheme,a message transmission scheme, a chat message transmission, and a WIFIDirect transmission scheme.
 20. The method of claim 12, wherein thecaptured screen image comprises one of an entire image of the capturedscreen and a partial image of the captured screen.
 21. The method ofclaim 18, wherein the data format is one of a scrapbook file (SCC) dataformat and a format data comprised of an image and a text.
 22. Anon-transitory storage medium storing a program for using a capturedscreen image, the program executed in a controller of an electronicdevice comprising a command to perform a method, the method comprising:capturing a screen image of an application execution screen; obtainingexecution path information for executing a state of the captured screenimage; storing the captured screen image and the execution pathinformation; and transmitting the captured screen image and theexecution path information to share the captured screen image and theexecution path information.
 23. A data sharing server comprising: astorage unit configured to store data including a captured screen imageand execution path information corresponding to the captured screenimage, the data being uploaded from a first electronic device; and acontroller configured to, when the data is uploaded, transmit the storeddata to a second electronic device that accesses the data sharing serverwith the same account as that of the first electronic device.
 24. A datasharing server comprising: a storage unit configured to store dataincluding a captured screen image and execution path informationcorresponding to the captured screen image, the data being uploaded froma first electronic device; and a controller configured to transmit aUniform Resource Locator (URL) of uploaded data to the first electronicdevice when the data is uploaded, and to transmit the uploaded data to asecond electronic device upon receiving a data request made based on theURL of the uploaded data from the second electronic device that hasreceived the URL of the uploaded data from the first electronic device.